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Abstract — Precise and effective bony segmentation from soft 
tissues on hand radiograph is very critical in the bone age 
assessment, especially for separating phalanx and 
epiphyseal/metaphyseal region of interests (EMROIs) from the 
background and soft tissue. Our aim is to locate and segment the 
EMROIs based on children’s hand radiographs, in which the 
images are with nonuniform background. Furthermore, a great 
destructive noise may suppress the segmentation process. The 
proposed approach combines a series of image preprocessing 
procedures to crop the left-hand radiograph and EMROIs. The 
experiments were conducted on different parts of knuckles, such 
as distal, middle, and proximal. Finally, the segmentation results 
demonstrate that the proposed schemes can segment the 
EMROIs automatically and effectively for the extraction of 
characteristics of bone age assessment. 
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I. Introduction 

Bone age (BA) is significant for diagnosing the growth 
potential of children. Clinically, pediatricians make a decision 
for a child with growth disorders, growth hormone deficiency, 
and the efficacy of growth therapy by determining if the 
discrepancy between the BA and the chronological age (CA) is 
consistent. Thus, the bone age assessment (BAA) is widely 
applied by evaluating the ossifications of carpals, phalanges, 
ulna and radius, and the epiphysis/metaphysic. 

Greulich and Pyle (GP) atlas [1] and Tanner- Whitehouse III 
(TW) method [2] are two preferred methods which can help the 
pediatricians and radiologists evaluate children’s BA. The 
former is to test the consistency of the left-hand ragiograph and 
the corresponding chronological age (CA) by a visual 
comparison with standard atlas of hand radiograph. Then, the 
best matching standard can be selected as the appropriate 
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pattern. Such an approach allows most pediatricians to 
determine BA easily, but human subjectivity and qualitative 
analysis cause the operation be lack of repeatability and 
reliability [3,4]. Comparing to TW method, the usage is to 
assess the BA by assessing the detailed shape analyses of 
several bones of interest and conducting to corresponding 
scores. Subsequently, to sum up all the TW scores, the most 
approaching bone stages can be determined. Accordingly, the 
TW method serves a more objective examination than the GP 
method, but the drawbacks of complexity and time-consuming 
cause TW method relatively rare use in clinical practice [3]. 

An increasing attention has been paid to the development of 
automatic computerized analyses of BA by using a series of 
image processing techniques. The advantages of BAA are 
including reproducibility and reliability; therefore, many 
reports focusing on the precise computer-based BAA have 
been made for improving the performance [4,5]. In that work, 
image segmentation can be seen as the most difficult tasks in 
the BAA. Therefore, another grayscale-histogram morphology 
algorithm, or a gamma parameter enhancement algorithm for 
the segmentation of phalanx (PROIs) and 
epiphyseal/metaphyseal region of interests (EMROIs) was 
suggested to achieve the goal with the greatest possible 
precision [6,7]. 

As for the gray-level image segmentation, the extent of 
similar brightness and the gray levels of neighboring pixels at 
the boundaries of the sub-blocks change, can have certain 
influence on the detection of isolated points, lines and edges. 
In generally, the approaches based on homogeneity and 
intensity can be attributed to thresholding, edge detection, 
clustering and region growing [8]. Recently, a new novelty of 
neutrosophic set (NS) concept, proposed by Florentin 
Smarandache as a new branch of philosophy dealing with the 
origin, nature and scope of neutralities, as well as their 
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applications in the different ideational spectra [9]. As 
neutrosophy theory mentioned, each event or entity has a 
certain degree of truth, a falsity degree and an indeterminacy 
degree that can be defined as independent from each other. 

In our study, the EMROIs are extracted by using a series of 
image preprocessing procedures. Next, the initial image 
enhancement based on gray level distribution was adopted to 
make the phalanx contour region clear. Following, the k-means 
clustering algorithm was applied to separate epiphysis and 
metaphysis from the soft tissue and background. 



II. Experiment Methods 

Initially, the lower resolution version of hand radiograph 
reduce the computation time, and therefore the images was 
resized to a fixed scale of 0.25 for improve the computation 
time. Next, the hand radiographs contain some artifacts of 
labels and noises, which interfere with the segmentation 
framework. Therefore, to find a background image can be 
helpful to suppress the nonuniformity for improving the hand- 
to-background ratio [10]. Subsequently, a profile of top-bottom 
scan was executed to find out the edge of left-hand region. 
Finally, the left-hand can be successfully cropped. The 
schematic representation of pre-processing stage is 
demonstrated in Fig. 1. 
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Figure 1 . Schematic diagram of cropped left-hand radiograph. 



Generally, the cropping left-hand radiograph is not a 
purified image for extracting the middle finger. To locate and 
segment the middle finger precisely, several further processes 
are suggested. The heuristic procedures shown in Fig. 2 are 
explained below. 

a) Acquire the cropped left hand image. 

b) Binary the left-hand radiograph with Otsu’s 
thresholding. 

c) Fill the regions circumscribed by edges, erode the 
regions and then leave the largest area. 

d) Remove the arm region from the shortest width to the 
bottom of the previous binary image. 

e) Map to the hand radiograph and apply the line scan 
from top to bottom. 

f) Focate the local extremes of maximum. Then connect 
the local extremes to detect the three fingers which 



were defined as the ring finger, middle finger and 
index finger respectively. 

The physiological meanings of PROI contain three parts of 
joint, e.g. the EMROIs. Therefore, EMROIs can be searched 
out by the local extremes from the projection profile of the 
PROI easily (see Fig. 3 a). The phalange information can be 
extracted from the background for identifying the three 
knuckles of medius and the third metacarpal. The proposed 
procedures are listed below: 

a) Rotate the finger with -90° along horizontal direction. 

b) Sum each column vector into a profile and then smooth 
the resultant profile (see Fig. 3b). 

c) Filter the resultant profile by using a moving average 
filter (see Fig. 3c). 

Focate the position of the knuckle between medius and the 
third metacarpal by local extremes. 
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Figure 2. Schematic of detecting middle finger. 
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Figure 3. (a)The cropped middle finger, (b) Profile of the accumulated gray- 
level intensity of (a), (c) Profile of (b) subtraction by using its moving average 

filter. 










A. Neutrosophic theory 

In neutrosophic theory, each event can be seen as a certain 
degree of truth, falsity and indeterminacy, which are 
independently from each other [9]. Thus, for a theory, event, 
concept, or entity, {A} is existed with its opposite {Anti-A} 
and the neutrality {Neut-A} simultaneously. On the contrary, 
the {Neut-A} and {Anti-A} are represented to as {Non-A}. 
According to this theory, each event {A} is playing a role of 
neutralization between {Anti-A} and {Non-A}. For example, if 
<A> = white, then <Anti-A> = black, <Non-A> =black, gray, 
and intermediate states between them, and <Neut-A> = 
intermediate states between them but excluding the white and 
black, etc. Such an idea serves a novelty to cope with the 
indeterminate problem, i.e. the image with uncertainty 
information. In this section, neutrosophic set was introduced 
into our study for implementing the segmentation of the 
EMROIs, and the descriptions were defined as below. 

B. Neutrosophic set: 

In this paper, the boundary information between the bony 
and soft tissue are unclear and hard to detect. Therefore, a pixel 
of an image, p(j 9 j ) , can be used as an alternative indication of 

P = [tj 9 /}, which represents the pixel is t% true (EMROIs), 
i % intermediate (bony boundaries), and f % false (others), 
where te T , is I and fsF, and T , / and F indicate true, 
indeterminacy and false domains individually [8,11]. 
Traditionally, fuzzy set can be regarded as z = 0 , and 0<t,f 
< 100; however, a neutrosophic set is defined as 0 < t, i , f < 
100. Thus, we can apply the property by a three-level model to 
make the segmentation more adaptive. 

In the computation, the pixel p(j 9 j) in the image domain is 
transformed into the neutrosophic domain, 
P N s(i,j) = {T(i,j)J(i,j), F (i,j)}, and the formulations can be 
defined as: 
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where g(i,j ) and g(i 9 j) is the intensity and local mean 
intensity of the image at the position (/, /') . 

1) a-mean operation: 

The a-mean operation for P NS , P NS ( (X ) is shown as: 
P NS {a) = P{T{a)J{a\F{a)) (6) 

where 
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where T(i,j) and T(i,j) are the mean intensity and the 
corresponding mean value after the a-mean operation. After 
the a-mean operation, the distribution of each element in I 
becomes more uniform and therefore the entropy of the 
indeterminacy / can be improved. In this experiment, Ot is 
selected as 0.9 by empirically experiments. 

2) /3-enhancement operation: 

A (3-enhancement operation for P NS , P NS (/?) is formulated 
as: 
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where T'(i,j) and T'(i,j ) are the intensity and its local mean 

value after the (3 -enhancement operation. After the (3- 
enhancement operation, the membership set T becomes more 




distinct for the purpose of segmentation. Also, /3 is selected as 
0.9 in our experiments. 

3) Neutrosophic entropy: 

The entropy of the neutrosophic image is applied to the 
employment of estimating the gray-level image histogram as a 
probability distribution, and the summed entropies of the three 
sets, T, I and F, are shown 
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where En T , En I and Efl F are the entropies of the sets T, I, 

and F individually, whose values equal to the element i in T, 
I and F . 

4) K-means clustering analysis on neutrosophic set 
Because clustering method can effectively categorize 

similar pixels into the same group [11], the P NS ((X, which 
was proceed by the a-mean operation and (3-enhancement 
operation can be applied to classification. To consider T'(i,j) 
as an unclassified data set, the clustering problem means to 
classify the T'(i,j) into m partitions which were represented 
as C = |c.,y = l,2,...,/w| • Here, the employed K-means 
algorithm as the clustering method, is defined as 
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where Z . is the centroid of the jth cluster and m is the 

amount of clusters. Additionally, the necessary definition of the 
minimum J c is 
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where Uj is the number of pixels in the jth cluster, C ■ . 



C. Apply the NS algorithm to EMROI 

The related algorithm is summarized in the following steps: 

a) Input the image and transfrom the image into NS 
domain by Eqs. (l)-(5); 

b) Perform the a-mean operation and (3 -enhancement 
operation on the subset T by Eqs. (6)-(21); 

c) Compute the entropy of the indeterminate subset I, 
EnXi) by Eqs. (22)-(25); 



d) If (Ep (i + 1) - Ep ( 0 ) / Ep (i) less than S , apply the 

K-means clustering algorithm to the subset T; else go to 
Step (b). 

Finally, we can obtain the EMROI segmentation. 



III. Results and Discussion 

The procedures based on NS for EMROI segmentation was 
demonstrated in Figure 4. In this framework, the EMROI was 
operated by using the NS operation as the first step, to let the 
bony tissue more distinct. Subsequently, the enhanced EMROI 
was categorized by K-means method as white color, gray color 
and black color, in the second step. The region with highest 
centroid, i.e. with white color, was chosen as the EMROI in the 
third step. In the fourth step, due to some broken holes in 
EMROI, the process of performing a flood-fill operation is 
employed, and the segmented EMROI was completed. Because 
the bony and soft tissue contains nonuniform gray-levels, it can 
be concluded that the higher gray-levels indicates the mixture 
of bony and soft tissue, and the lower gray-levels corresponds 
to the soft tissue and background. The image segmentation 
scheme serves robustness against these poor images. 
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Figure 4. The procedures of performing EMROIs segmentation. 



Here, the segmentation performances based on the NS 
enhancement for three ages of 3 years, 8 years and 12 years 
individually, are given in Figure 5-7. Figure 5(a)-(c) are 
displayed the original EMROIs with the distal, middle, and 
proximal and their corresponding segmentation results are 
shown in Figure (d)-(f). Another two examples are also 
demonstrated in Figure 6 and 7. Evidently, our proposed 
segmentation scheme is very close to the observation; despite a 
little defect occurred, e.g. the Figure 5(e), (f) and Figure 6 (f), 
the most important regions of EMROIs and the corresponding 
physiological features are still preserved. 
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Figure 5. A3 years girl with three cropped EMROIs and their corresponding 
segmented results. 





Figure 6. A 8 years girl with three cropped EMROIs and their corresponding 
segmented results. 




IV. CONCLUSIONS 

In this study, a novelty of NS approach to EMROIs 
segmentation is introduced. Based on the a-mean operation and 
(3-enhancement operation, the structure of the image becomes 
uniform but with distinct edges. Finally, the segmentation 
algorithm based on the k-means clustering method was 
proposed to segment the EMROIs from the background and 
soft tissue. The demonstrated results reveal that the method can 
help to segment the bony tissue precisely for assisting the BAA 
and monitoring the growth therapies. 
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Figure 7. A 12 years girl with three cropped EMROIs and their 
corresponding segmented results. 



















